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Receive image that 
includes first region and 
second region 



Receive input selecting 
third region that includes 
first and second regions 



Determine based on color 

arrangements of first 
region and second region 
which pixels satisfy criteria 
for classification as 
located in first region 



Determine based on color 
arrangements of first 
region and of second 
region which pixels satisfy 
criteria for classification as 
located in second region 
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classification as located in 
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Decontaminate identified 
pixels 
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Repeat steps 120 through 
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be extracted 



170 



180 



Isolate and modify first 
region 



FIG. 1 



Appin No.: 10/693,295 
Applicant(s): Schiller et al. 



REPLACEMENT SHEET 



Page 2 of 13 



200 



Receive image that 
includes first region and 
second region 
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Receive first input defining 

third region of image in 
which a boundary between 
first and second regions is 
to be located 



Receive second input 
defining fourth region of 
image to be used for 
training neural network 
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Train neural network 
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Use neural network to 
classify pixels of third 
region as either located in 
first region or located in 
second region 



220 



230 



240 



250 



Scale classification 
provided by neural network 
and generate probability 
mask 
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Define boundary mask 
from probability mask 
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Decontaminate pixels 
identified by boundary 
mask and sharpen 
boundary between first and 
second regions 



Multiply boundary mask 
with mask produce by 
decontamination 
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Randomly select training 
element from one of two 
training sets of elements 



Input selected training 
element to neural network 

in its current state and 
receive response of each 
node to this input 
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Execute backward 
propagation process 
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Repeat steps 410-430 
until maximum number of 
iterations are reached or 

until neural network is 
giving sufficiently correct 
responses on training set 
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Compute difference D 
between desired output 
and actual output of 
node N 



For each internal 
parameter p of node N, 
compute partial derivative 
of output with respect to p 



Compute incremental 
change to p 
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Propagate difference D up 
nodes in next layer up 
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Repeat steps 510-550 for 
each node on next layer up 
until all nodes in neural 
network has been 
processed 
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Apply incremental change 
to each internal parameter 
of node N 
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For each location P in 
color innage, consult 
classifier as to whether P 

is in foreground, 
background or boundary 
areas 
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If P is in foreground 
initialize corresponding 
pixel in opacity mask to 
maximum possible value 
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If P is in background, 
initialize corresponding 
pixel in opacity mask to 
minimum possible value 
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Compute scalar value a 

between 0 and 1 that 
minimizes the difference 
D(C(P). LRP(C(F), C(B), 
a)). 
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A new color C(F) is 
assigned to the color 
image at location P 
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A value a*255 is assigned 
to the opacity mask at 
location P 



If the location is in 
boundary: find closest 
location to P that is in 
background B; and 
proceed to step 650 
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Find closest location to P 
that is in foreground F 
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800 



Scale values in the input 
vector A to range from 0 
to1 
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Apply hypersphere 
mapping transform to input 
vector A 
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Compute output value for 
each hidden node 
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Computer output value of 
output node 
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Scale values in the input 
vector A to range from 0 
to1 
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Apply hypersphere 
mapping transform to input 
vector 
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Compute output value for 
each hidden node 
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Computer output value for 
each gating node 
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Compute output value for 
each multiplication node 



Compute output for output 
node 
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